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ABSTRACT 


This  report  proposes  a  design  of  an  adaptive  receiver  for  the  detection  and 
estimation  of  nearly  periodic  signals  in  additive  Gaussian  noise.  A  nearly  periodic 
signal  is  defined  to  be  a  sample  function  of  a  Gaussian  random  process  which  can 
be  divided  into  equal  length  intervals,  called  periods,  in  such  a  manner  that  the 
correlation  between  periods  decreases  exponentially  with  their  separation.  The 
receiver  computes  a  low  signal-to-noise  ratio  conditional  likelihood  ratio  from  which 
the  observer  must  make  decisions.  The  likelihood  ratio  is  conditional  because 
the  receiver  estimates  any  u.  known  parameters  necessary  for  the  computation 
of  the  true  likelihood  ratio .  Thus  the  receiver  can  only  compute  a  likelihood  ratio 
conditioned  upon  these  estimates  being  the  true  values  of  the  unknown  parameters. 
The  receiver  consists  of  pre-emphasis  filters  followed  by  a  comb  filter ,  energy 
detector,  and  weighted  summation.  A  theoretical  evaluation  of  the  receiver,  in 
terms  of  ROC  curves,  is  made  for  the  special  case  of  nearly  periodic  signals  with 
satistically  independent  equal -strength  harmonics  in  white  noise  of  known  power. 
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THE  ADAPTIVE  DETECTION  AND  ESTIMATION  OF  NEARLY  PERIODIC  SIGNALS 


T.G.  Kincaid* 


I.  INTRODUCTION 

This  report  proposes  a  system  design  of  an  adaptive  receiver  for  the  detection  and  estimation  of  nearly 
periodic  signals  in  additive  Gaussian  noise.  A  nearly  periodic  signal  is  very  much  like  a  periodic  signal,  but 
fails  to  be  periodic  because  its  waveform  is  slowly  changing  with  time.  In  this  report,  a  nearly  periodic  signal 
is  more  precisely  defined  as  a  sample  function  of  a  Gaussian  random  process  which  can  be  divided  into  equal- 
length  intervals,  called  periods,  in  such  a  manner  that  the  correlation  between  periods  decreases  exponentially 
with  their  separation . 

The  receiver  design  is  based  on  the  philosophy  of  minimization  of  average  decision  cost,  which  leads  to  a 
receiver  that  computes  a  likelihood  ratio  and  compares  it  with  a  threshold.  However,  the  proposed  receiver 
does  not  perform  strictly  in  this  manner  for  three  reasons.  First,  since  the  parameters  which  determine  the 
threshold  are  not  known,  the  proposed  receiver  leaves  the  threshold  comparison  to  an  observer.  Second,  some 
parameters  necessary  for  the  design  are  estimated  from  the  received  data  and  inserted  in  place  of  the  true 
values,  which  are  unknown  to  the  designer.  Thus  the  receiver  is  only  capable  of  computing  a  likelihood  ratio 
conditioned  upon  the  unknown  A  arameters  having  their  estimated  values.  Third,  the  proposed  receiver  is  the 
low  signal-to-noise  ratio  approximation  to  the  receiver  dictated  by  the  theoretical  analysis.  This  approximation 
results  in  comparatively  simple  receiver  implementation  without  sacrificing  threshold  performance. 

The  operation  of  the  proposed  receiver  can  be  satisfyingly  interpreted  in  terms  of  the  estimator- correlator 
structure  described  by  Kailath,  (24)  followed  by  an  incoherent  summing  operation.  However,  the  receiver  is 
more  easily  implemented  if  given  an  alternate  interpretation,  consisting  of  three  distinct  filtering  operations 
followed  by  energy  detection  and  the  incoherent  summing.  The  first  two  filtering  operations  are  pre-emphasis 
filters  which  build  up  the  high  signal-to-noise  ratio  regions  of  the  input.  The  third  filter  is  a  frequency  domain 
comb  filter  with  tooth  separation  equal  to  the  inverse  of  the  period  of  the  nearly  periodic  signal,  and  tooth 
width  determined  by  the  intra  period  correlation  of  the  nearly  periodic  signal.  This  comb  filter  is  the  heart  of 
the  receiver,  and  can  easily  be  implemented  as  a  circulating  adder,  which  coherently  adds  weighted  sequential 
periods  of  the  pre-emphasized  input.  The  comb  filtering  is  followed  by  energy  detection  and  an  incoherent 
summing  operation. 

A  partial  evaluation  of  the  receiver  has  been  made  by  considering  only  the  performance  of  the  processor 
without  the  incoherent  summing.  Confining  the  evaluation  to  this  part  of  the  processor  makes  theoretical 
evaluation  tractable.  The  evaluation  is  made  for  an  input  consisting  of  a  nearly  periodic  signal  with  statistically 
independent  constant  amplitude  harmonics  and  additive  white  Gaussian  noise  of  known  power.  The  evaluation 
is  made  in  terms  of  Receiver  Operating  Characteristics  (ROC),  which  display  the  probability  of  detection  vs 
the  probability  of  false  alarm. 

II.  ADAPTIVE  RECEIVER  DESIGN  PHILOSOPHY 

This  section  sets  forth  the  philosophy  used  to  design  the  adaptive  receiver  for  nearly  periodic  signals. 

The  philosophy  presented  here  is  a  summary  of  the  literature  in  the  area,  and  is  general  enough  to  be  applied 
to  a  variety  of  adaptive  receiver  design  problems. 

A.  Receiver  Design 

The  basic  function  of  any  receiver  is  to  make  decisions  about  the  values  of  one  set  of  random  variables 
(messages)  given  the  values  of  a  different  set  of  random  variables  (data).  We  usually  distinguish  two  different 
functions  of  receivers:  detectors  make  decisions  which  are  either  right  or  wrong,  and  estimators  make 
decisions  which  are  seldom  exactly  right,  but  can  often  be  close.  The  same  receiver  may  perform  both 
functions. 


♦General  Electric  Company,  Heavy  Military  Electronic  Systems,  Syracuse,  New  York.  Work  carried  out  at 
General  Electric  Company,  Research  and  Development  Center ,  Schenectady,  New  York,  12301. 
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How  do  you  design  such  a  receiver?  As  a  starting  point,  we  note  that  all  we  can  know  about  the  message  • 

random  variables  is  contained  in  their  joint  probability  density;  thus,  it  seems  reasonable  that  the  receiver 
should  first  compute  the  joint  probability  density  of  the  message  variables  conditioned  upon  the  known  values 
of  the  data  variables.  This  is  called  the  posterior  probability  density  of  the  message;  i.e. ,  the  density  after 
the  data  are  known.  The  receiver  can  then  make  decisions  based  on  the  computed  posterior  density,  according  • 

to  any  criterion  of  goodness  based  on  average  performance .  Our  guiding  principle  will  therefore  be  that  the 
receiver  is  to  be  designed  in  two  parts:  (1)  a  posterior  probability  computer,  and  (2)  an  estimation  or  detec¬ 
tion  decision  maker. 

B.  Adaptive  Receivers 

There  seems  to  be  no  rigorous  definition  of  what  constitutes  an  adaptive  system.  Scudder's  concept^)  of 
an  adaptive  system  as  one  "--whose  behavior  changes  with  time,  depending  upon  the  input, "  is  certainly  broad 
enough  to  contain  the  thinking  of  most  authors  on  the  subject.  However,  this  definition  is  too  general  to  allow 
the  design  of  a  canonic  adaptive  receiving  system,  so  the  design  is  still  an  art. 

A  number  of  authors  have  shown  how  the  use  of  the  Bayes  rule  (Section  II-C  below)  to  compute  posterior 
probabilities  can  lead  to  an  adaptive  processing  system.  This  is  accomplished  either  directly  using  a  sequential 
form  of  Bayes'  rule.  $-8)  0r  indirectly  by  appropriate  interpretation  of  the  formulas  describing  the  receiver 
resulting  from  the  application  of  Bayes'  rule.  (®)  However,  the  practical  application  of  the  Bayes  rule  approach 
has  proved  difficult.  One  problem  is  that  the  resulting  receiver  may  grow  exponentially  in  complexity  as  more 
and  more  data  are  received.!®)  A  more  fundamental  difficulty  is  the  so-called  "a  priori"  problem. (10- 13)  The 
a  priori  problem  arises  because  it  is  necessary  for  the  computation  of  posterior  probabilities  by  Bayes'  rule 
that  the  prior  probabilities  be  known  for  both  the  message  random  variables  and  any  unknown  parameters 
required  to  design  the  receiver. 

Some  designers  have  avoided  both  the  complexity  and  a  priori  problems  by  designing  systems  according  to 
some  criterion  other  than  the  computation  of  posterior  probabilities.  (14-16)  For  those  who  insist  on  the  rigorous 
computation  of  posterior  probabilities,  Spragins^17)  has  demonstrated  that  the  complexity  problem  can  be  over¬ 
come  only  by  the  use  of  sufficient  statistics  and  reproducing  densities,  an  area  also  investigated  by  Birdsall.  t1®) 

It  appears  that  for  many  applications  sufficient  statistics  can  be  found,  although  it  may  be  necessary  to  make 
some  approximations,  (i®)  The  more  difficult  a  priori  problem  has  not  yet  been  satisfactorily  resolved.  The 
currently  favored  approach  is  to  use  the  principle  of  maximum  entropy,  with  any  prior  knowledge  as  con¬ 
straints,  to  derive  prior  probability  densities. I1®*  *®)  If  enough  input  data  is  available  to  the  processor,  it 
can  be  shown  that  under  rather  general  conditions  the  choice  of  prior  probability  density  is  irrelevant,  provided  » 

it  does  not  exclude  the  true  value  of  the  parameter  sought.  (28) 

Another  approach  (Section  II-D  below)  to  overcoming  the  complexity  and  a  priori  problems  inherent  in  the 
use  of  Bayes'  rule  is  to  estimate  the  unknown  parameters  from  received  data,  and  then  to  insert  the  estimates 
in  place  of  the  actual  values.  (20,  21)  This  results  in  an  inherently  adaptive  receiver,  but  one  which  does  not 
actually  compute  the  posterior  probabilities.  However,  the  use  of  estimates  for  the  unknown  parameters 
makes  the  receiver  asymptotically  equivalent  to  the  desired  posterior  probability  computing  receiver  if  the 
estimates  approach  the  true  values.  Even  so,  this  limiting  condition  is  never  reached  in  practice,  and  often 
cannot  even  be  approached  arbitrarily  closely  because  the  true  values  of  the  parameters  are  changing.  What 
this  type  of  "suboptimal"  receiver  actually  computes  is  the  posterior  probabilities  of  the  desired  variables, 
conditioned  upon  the  unknown  parameters  having  their  estimated  values. 

In  summary,  an  adaptive  receiver  can  arise  from  at  least  two  considerations,  both  of  which  may  be  used 
in  the  same  receiver.  The  first  is  the  use  of  the  sequential  form  of  Bayes'  rule  to  compute  posterior  proba¬ 
bilities.  The  second  is  the  use  of  current  estimates  of  parameters  in  place  of  true  values. 

C.  Computation  of  Posterior  Probabilities 

Suppose  a  receiver  is  given  a  data  signal  Z  which  contains  information  about  a  message  random  variable, 

Q,  whose  value  we  wish  to  determine.  (Two  random  variables  contain  information  about  each  other  if  they  are 
dependent.)  Then,  according  to  our  philosophy,  the  receiver  first  computes  f(Q/Z),  the  probability  density 
function  of  Q  given  Z.  The  computation  of  f(Q/Z)  can  be  carried  out  using  Bayes'  rule,  viz. 

f(Q/Z)  =  t(Z/Q)f(Q)/f(Z)  .  (n-i) 

The  term  f(Q)  is  the  prior  probability  density  function  of  the  message  Q,  i.e. ,  the  probability  density 
function  of  Q  before  Z  is  received.  As  discussed  above,  the  precise  specification  of  this  function  is  still  a 
matter  of  philosophical  discussion,  and  it  figures  prominently  in  the  subsequent  decisions.  It  is  sufficient  for 
now  to  note  that  the  prior  density  does  not  depend  upon  the  input  Z . 
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The  term  t(Z/Q)  does  depend  upon  Z.  Although  t(Z/Q)  is  a  probability  density  function  for  the  random 
variable  Z,  we  are  interested  in  t(Z/Q)  as  a  function  of  Q,  since  we  ultimately  wish  to  compute  the  probability 
density  function  f(Q/Z)  on  the  left  of  Eq.  (n- 1).  As  a  function  of  Q,  l(Z/Q)  is  not  a  probability  density  function, 
and  it  is  commonly  called  the  likelihood  function .  Note  that  since  the  likelihood  function  contains  the  input  signal 
Z  as  a  parameter,  its  functional  form  is  dependent  upon  the  input. 

The  term  f(Z),  the  prior  probability  den  sity  function  of  Z,  is  also  dependent  upon  Z.  However,  it  is  not 
independent  of  the  form  of  the  likelihood  function  because  of  the  constraint 

J dQf(Q/Z)  =  J  dQ  t(Z/Q)f(Q)/f(Z)  =  1  .  (II-2) 

Thus  we  can  view  f(Z)  as  a  normalizing  constant,  and  write 

f(Q|  Z)  =  a  t(Zl  Q)f(Q)  .  (n-3) 

where 

a-1  =  j  dQdZIQ)f(Q).  (H-4) 

Since  f(Q)  is  specified  a  priori,  and  since  the  normalizing  constant  a  depends  upon  the  likelihood  function 
through  Eq.  (H-4),  an  important  function  of  the  receiver  is  the  computation  of  the  likelihood  function  t(ZI  Q). 

We  wish  now  to  consider  what  happens  when  the  receiver  receives  two  successive  inputs,  Zt  and  Z2,  which 
contain  information  about  the  message  Q.  After  the  first  input,  the  receiver  computes 

f(Q!  Zt)  =  a,t(Z1|Q)f(Q)  .  (H-5) 

After  receiving  the  second  input,  the  receiver  computes 

f(Q|  Zi,  Z2)  =  a2t(Z,,Z2|Q)-(Q)  ,  (n-6) 

in  order  to  take  advantage  of  all  the  information  in  both  Zt  and  Z2. 

In  general,  for  a  set  of  k  inputs  [Z^  containing  information  about  a  message  Q,  the  receiver  computes 

f (Q |  { ZjJk)  =  ak-t((  Zt}k |  Q)f(Q)  ,  (H-7) 

with  a^  computed  as  in  Eq.  (II-4).  In  Eq.  (n-5),  the  likelihood  function  depends  only  on  the  input  Z1(  and  we 
have  a  "one-shot"  receiver.  In  Eq. (H-7),  the  likelihood  function  depends  upon  the  whole  input  sequence  {Z^, 
and  therefore  describes  a  "multishot",  or  sequential,  receiver.  As  with  the  "one-shot"  receiver,  an  important 
function  of  the  sequential  receiver  is  the  computation  of  the  likelihood  function  Q). 

As  has  already  been  noted,  the  likelihood  function  is  a  function  of  Q  and  not  the  f  Zj}^  in  the  context  of 
Eq.  (11-7).  Rather,  the  (Zj}^  are  parameters  of  the  likelihood  function  that  determine  us  functional  form. 

Thus  the  likelihood  function  will  change  in  a  manner  determined  by  the  receiver  inputs.  It  is  this  view  of  the 
sequential  computation  of  posterior  probabilities  which  leads  some  authors  to  call  this  type  of  receiver 
adaptive. 


D.  Treatment  of  Unknown  Parameters 


It  almost  always  happens  that  the  likelihood  function  contains  parameters  which  are  unknown,  but  which  are 
critical  to  the  evaluation  of  the  likelihood  function.  These  parameters  may  be  associated  with  the  message 
bearing  signal  (e.g. ,  amplitude,  phase),  the  noise  (e.g. ,  noise  variance),  or  some  other  aspect  of  the  problem. 
We  shall  describe  two  methods  of  dealing  with  this  problem:  the  marginal  density  method,  and  the  estimation 
method. 

1.  The  Marginal  Density  Method 

The  most  widely  proposed^5  ^2)  method  of  handling  unknown  parameters  is  to  compjte  the  joint  density  of 
the  message  and  the  unknown  parameters,  and  then  to  integrate  over  the  unknown  parameter  random  variables 
to  obtain  the  (marginal)  density  of  the  message. 

The  computation  is  as  follows.  For  a  message  Q  and  an  unknown  parameter  A,  the  posterior  density  of 

Q  is 
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f(QlfZi)k)=  j’dAf(Q,A|{Z1}k) 

=  J  dAakt({ZiJk|Q,A)f(Q>A) 

=  ak[JdAt(fZi}k|Q,A)f(A|Q)]f(Q)  .  (n-8) 

Thus  the  likelihood  function  is 

-t(f  Zj J k|  Q)  =  J dAt((Zi}k|Q,A)f(A|Q)  .  (II-9) 

It  often  happens  that  Q  and  A  are  independent,  in  which  case  only  the  unconditional  prior  density  of  A  is  needed 
for  the  likelihood  function. 

The  problem  with  this  approach  is  that  the  likellhod  function  cannot  be  computed  without  the  prior  proba¬ 
bility  density  of  the  unknown  parameter.  Since  this  density  is  usually  not  known,  it  must  either  be  assumed  or 
plausibly  derived  by  some  technique  such  as  maximum  entropy. 

2.  The  Estimation  Method 

When  the  prior  probability  density  of  an  unknown  parameter  is  not  known,  a  "suboptimal"  receiver  must 
be  used.  One  possibility  is  to  design  the  receiver  as  though  the  parameters  were  known,  and  then  substitute 
estimate^  of  the  parameters  for  their  true  values. 

To  understand  the  meaning  of  the  estimation  method,  consider  the  computation  of  the  joint  density  of  the 
message  and  the  unknown  parameter;  however,  instead  of  computing  the  complete  joint  density  of  the  message 
Q  and  the  unknown  parameter  A,  we  compute  the  probability  density  of  Q  only  for  A  equal  to  its  estimated 
value  A.  Thus  we  compute 


f(Q,A=A|  [ Z!}k)  =  akt({Zl]k|Q,A=A)f(Q,A=A)  .  (11-10) 

After  normalization,  the  function  on  the  left  of  Eq.  (n-10)  becomes  the  density  of  Q  given  ( Zj}k  and  A=A. 
Thus,  the  estimation  method  can  be  thought  of  as  the  computation  of 

f(QI{Zi)k,A)  =  akt'(Zi}k|Q,A)f(Q|A)  (11-11) 


where 

,  JdQf(Q,A=A) 

^  ^  JdQf(Q,A=A|{Zi)k) 


(11-12) 


The  constant  ak  is  required  to  normalize  the  two  probability  density  functions.  Equation  (n-11)  shows  that  the 
resulting  receiver  computes  the  posterior  density  of  the  message,  given  that  the  parameter  has  its  estimated 
value.  Thift«density  converges  to  the  desired  posterior  density  of  the  message  as  the  parameter  estimate 
converges  to  its  true  value.  For  some  kinds  of  estimates  (Section  n-E-2  below)  it  is  not  necessary  to  know 
the  prior  density  of  the  unknown  parameter.  When  these  estimates  are  used,  the  a  priori  problem  does  not 
arise . 


If  the  unknown  parameter  estimates  are  continually  updated  as  new  data  are  received,  then  the  receiver 
will  be  constantly  changing.  Furthermore,  the  receiver  may  have  the  ability  to  change  its  form  in  response 
to  a  slowly  changing  parameter,  e.g. ,  noise  variance.  Thus  a  receiver  which  handles  unknown  parameters  by 
the  estimation  method  can  be  called  adaptive . 

E.  Decision  Making 

1.  Detection 

We  shall  concern  ourselves  only  with  the  problem  of  deciding  between  two  possible  values  of  a  message 
variable,  given  the  received  data;  thus,  a  message  Q  can  take  on  only  two  values,  Q,  or  Qo.  These  might 
represent  "target  present"  and  "target  absent,  *  respectively.  This  restriction  on  Q  gives  the  posterior 
density  for  Q  a  particular  form . 
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f(Q|Z)  =  a4(Z|Q)[m(Q-0i)  +  (l-u)«(Q-Q#)| 


(n-13) 


=  au  i(Z\ Q,)  5(Q-Qi)  +  a(l-u)  4(Z|  Qb)  5(Q-Qo) 

where  u  and  l-a  are  the  prior  probabilities  of  Qt  and  Qo,  respectively.  Note  that  the  posterior  probabilities 
of  Qt  and  Qo  are  aat  (Z|Qj)  and  a(l-u)  i(Z|  Qo),  respectively. 


Suppose  we  are  interested  in  determining  if  Q  =  Qt.  Then  the  possible  outcomes  of  the  decision  process 


are 


1.  detection 

2.  miss 

3.  false  alarm 

4.  (no  name) 


decide  Q  =  Qi  when  Q  -  Qt 
decide  Q  =  Qo  when  Q  ~  Qt 
decide  Q  =  Qi  when  Q  =  Q0 
decide  Q  =  Qo  when  Q  =  Q0  . 


01-14) 


Of  these  four  possibilities,  two  are  correct  decisions,  and  two  are  errors.  The  problem  is  to  make  f;ne 
decisions  in  some  best  way. 

We  shall  select  as  our  ideal  decision  criterion  the  minimization  of  the  expected  cost  of  our  decisions. 

We  can  denote  the  costs  of  the  four  outcomes  as  c- ,  where  i  refers  to  the  decision  and  j  to  the  actual  value 
of  Q.  Thus  c10  is  the  cost  of  deciding  Qi  when  actually  Q  =  Q0.  Then  the  cost,  c,  of  any  particular  trial  of 
the  experiment  is  a  random  variable,  wh'ch  can  take  on  any  of  the  values  Cjj . 

We  assume  that  the  cost  of  a  wrong  decision  is  higher  than  the  cost  of  a  correct  decision,  i.e. , 

>  c00 


cio 
Coi  >  C11 


The  receiver  which  minimizes  the  average  cost  ( c>  performs  the  Bayes  test,  (33,  34)  viz. 


compare 


(Z 


(1-u)  t,(Z|  Qo) 


with 


Con 


-01 


-  c, 


(II-15) 

(11-16) 

(II-17) 


and  decides  Qt  if  the  ratio  exceeds  ihe  threshold,  Qo  if  not.  The  Bayes  test  needs  posterior  probabilities, 
and  makes  their  role  in  the  decision  process  explicit.  It  is  more  common  to  write  the  Bayes  test  in  the  form 


compare  KZ)  =$§}§£ 


with 


(1-p)  (cu-Coq) 
u(Coi  -  CH) 


(II- IB) 


The  quantity  \(Z)  is  called  the  likelihood  ratio.  The  likelihood  ratio  depends  only  upon  the  likelihood  function 
t(Z|  Q),  and  is  independent  of  the  prior  probabilities  of  Q.  One  major  difficulty  with  the  Bayes  test  is  deter¬ 
mining  the  threshold  setting  on  the  right  of  relation  (11-18).  Not  only  is  there  the  a  priori  problem,  but  there 
is  the  additional  problem  of  assigning  costs.  It  seems  the  best  that  can  be  done  is  to  present  the  observer 
with  the  likelihood  ratio,  and  let  him  make  decisions.  In  effect,  the  observer  inserts  the  prior  probabilities 
and  costs  from  his  experience  and  knowledge  of  the  tac.ical  situation.  From  this  combination  he  sets  a  mental 
threshold  and  makes  his  decision. 

A  second  problem  with  the  Bayes  test  is  that  the  likelihood  ratio  cannot  be  computed  exactly  if  the  prior 
probabilities  of  the  unknown  parameters  are  not  available.  Our  philosophy  then  is  to  use  the  conditional 
posterior  probabilities  determined  by  the  estimation  method  described  in  Section  II-D- 2;that  is,  estimates  of  the 
parameters  are  used  as  though  they  were  the  true  values.  This  results  in  a  conditional  likelihood  ratio 
(author's  definition).  For  an  unknown  parameter  with  estimate  A,  the  conditional  likelihood  ratio  is 

x(z|A)  =  /  (ziQfc  i2  .  (ii- 19) 

c(Z|Qo,A) 
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The  methods  by  which  the  estimates  can  be  made  are  described  in  the  next  section.  When  A  is  a  maximum 
likelihood  estimate  (Section  II-E-2  below)  the  conditional  likelihood  ratio  is  equivalent  to  the  generalized 
likelihood  ratio. 

Since  it  may  not  be  possible  to  evaluate  the  receiver  by  costs,  we  need  another  method  of  evaluating  the 
receiver.  A  commonly  used  method  that  is  independent  of  the  message  prior  probabilities  is  the  receiver 
operating  characteristic  (ROC).  This  is  the  plot  of  the  probability  of  a  detection  (p^)  vs  the  probability  of  a 
false  alarm  (pf)  when  the  receiver  compares  the  likelihood  ratio  with  a  threshold  level  *1.  It  has  been  shown 
by  Neyman  and  Pearson”^ that  a  receiver  which  makes  detections  by  comparing  the  actual  likelihood  ratio  with 
a  threshold  will  maximize  the  probability  of  detections  for  a  fixed  probability  of  false  alarms.  This  theorem 
ensures  that  the  ROC  curves  will  rate  the  receiver  which  computes  the  true  likelihood  ratio  superior  to  the 
one  which  computes  a  conditional  likelihood  ratio. 

The  ROC  curves  are  determined  as  follows.  The  (conditional)  likelihood  ratio,  \,  is  a  random  variable. 
The  probability  of  detection  is  given  by 


pd  =  j*  d\  f(>.  I  Qi) 


(11-20) 


and  the  probability  of  a  false  alarm  is  given  by 

CD 

Pf  «  j  Hi  f (i  |  Qo)  . 
Jr) 


(11-21) 


Then,  the  ROC  curves  are  computed  by  choosing  values  of  n,  computing  p^  and  pj,  and  plotting  one  vs  the 
other. 


2.  Estimation 

There  are  two  principal  reasons  why  we  may  need  to  make  an  estimate  of  the  value  of  a  random  variable. 
It  may  be  that  the  random  variable  is  an  unknown  parameter  and  we  wish  to  have  the  estimate  for  use  in  the 
estimation  method  of  receiver  design  described  in  Section  II-D-2.  The  second  reason  is  that  the  random 
variable  may  be  a  message,  and  having  an  estimate  of  its  value  is  important  for  reasons  other  than  receiver 
design,  e.g.,  target  classification. 

Whatever  the  reason,  there  are  a  number  of  different  ways  of  making  estimates,  each  having  particular 
advantages  in  certain  situations. 

Unconditional  estimates  are  based  on  both  the  received  data  and  the  prior  density  of  the  unknown  param¬ 
eter.  Two  widely  used  unconditional  estimates  are: 


The  Minimum  Mean-Square  Error  (mms)  Estimate.  The  mms  estimate  of  a  random  variable,  A,  given 
the  value  of  a  random  variable,  Z,  is  the  value  A  of  A  which  minimizes 

e2  =  J dA  (A  -  A)2  f (A |  2)  .  (11-22) 

It  is  straightforward (34)  to  show  that  the  minimum  is  given  by  the  conditional  mean  of  A. 


J 


dA  Af(A|  Z) 


(11-23) 


The  Maximum  Posterior  Probability  (mpp)  Estimate.  The  mpp  estimate  of  a  random  variable,  A,  given 
the  value  of  a  random  variable  Z,  is  the  value  A  of  A  for  which  the  posterior  density  of  A  is  a  maximum;  in 
other  words,  A  is  the  most  probable  value  of  A  when  Z  is  known. 


A  =  A  for  which  f (A |  Z)  is  maximum. 


(11-24) 


This  estimate  is  also  called  the  maximum  a  posteriori  (map)  estimate. 


Conditional  estimates  depend  only  on  the  received  data.  Because  of  this,  conditional  estimates  can  be 
used  in  the  estimation  method  of  handling  unknown  parameters  (Section  II-D-2).  Two  popular  conditional 
estimates  are: 


The  Maximum  Likelihood  (m/J  Estimate .  The  m>,  estimate  of  a  random  variable,  A,  given  the  value  of  a 
random  variable,’  Z,  is  the  value  A  of  A  for  which  the  likelihood  function  for  A  is  a  maximum. 
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A  =  A  for  which  t(Z|A)  is  maximum. 


(n-25) 


In  other  words,  A  is  the  value  of  A  that  most  likely  caused  the  given  value  of  Z  to  occur. 

The  Likelihood  Ratio  (tr)  Estimate.  The  p  estimate  of  a  random  variable,  A,  given  a  random  variable, 
Z,  is  the  value  of  A  of  A  for  which  the  likelihood  ratio  of  a  message  Q  is  a  maximum. 

A  =  A  for  which  \ (Z | A )  is  a  maximum.  (n-26) 

This  estimate  is  the  most  widely  used  for  the  estimation  of  unknown  target  parameters  in  detection  problems; 
e.g. ,  range  in  sonar.  When  used  for  this  purpose,  it  is  equivalent  to  the  mi  estimate,  given  the  target  is 
present.  The  estimate  is  made  by  forming  the  likelihood  ratio  for  all  possible  values  of  the  unknown  param¬ 
eter,  and  choosing  the  l:*.,  ••  ,t  ratio.  This  is,  in  effect,  constructing  a  separate  likelihood  ratio  detector  for 
each  value  of  the  unknown  parameter,  and  choosing  the  value  of  the  parameter  corresponding  to  the  detector 
with  the  largest  output . 

m.  ADAPTIVE  DETECTION  AND  ESTIMATION  OF  NEARLY  PERIODIC  SIGNALS 

The  objective  of  this  bection  is  to  design  an  adaptive  receiver  for  the  detection  and  estimation  of  a  nearly 
periodic  signal  in  additive,  zero  mean,  Gaussian  noise.  The  detection  problem  will  be  given  primary  con¬ 
sideration,  the  estimation  coming  as  a  by-product. 

In  this  work  it  will  be  assumed  that  the  nearly  periodic  signal  is  a  sample  function  of  a  nonstationary 
Gaussian  random  process,  of  the  type  described  in  the  Introduction.  A  more  detailed  description  of  the  prop¬ 
erties  of  the  nearly  periodic  signal  are  given  in  Sections  III-A.B  below. 

A.  Known  Parameters 


We  shall  first  solve  the  detection  problem  when  all  parameters  are  known  except  whether  the  signal  is 
present  or  absent.  Then,  after  the  appropriate  receiver  is  derived,  the  extension  to  unknown  parameters  will 
be  made  by  the  methods  described  in  Section  II-D. 

We  shall  represent  signals  by  column  matrices  whose  entries  are  the  time  samples  of  the  signals.  We 
assume  that  the  receiver  input  signal  is  either  the  noise  only,  or  a  sum  of  the  noise  and  a  nearly  periodic  signal 
with  the  properties  described  above.  We  further  assume  that  only  s  successive  time  samples  of  the  input  are 
available.  Then  the  matrix  equation  for  the  input  signal  is 

Z  4  X+N,  (m-1) 


where  Z  is  the  input  signal  matrix; 

is  a  random  variable  which  is  either  1  or  0,  depending  upon  whether  the  nearly  periodic 
signal  is  respectively  present  or  absent; 

X  is  the  nearly  periodic  signal  matrix,  assumed  known  here;  and 

N  is  the  zero  mean  Gaussian  noise  signal  matrix. 

For  detection,  the  receiver  computes  the  likelihood  ratio 

'(zi  -i) 

{z>  i(ii-  -o)  • 


(in- 2) 


In  the  context  of  this  problem,  is  the  message  Q  in  Eq.(II-l).  Under  our  assumptions,  the  likelihood  function 
in  Eq.  (Ill- 2 )  can  be  written  as 

'(Zl  ■)  (2-rs/j  |«Nr'/2  expf-  -J  (Z-  X)*  ?N-'(Z--X)  .  (m-3) 


In  this  equation,  is  the  s  *  s  noise  covariance  matrix,  and  *  denotes  matrix  transposition. 

We  assume  that  when  the  input  signal  is  sampled  near  the  Nyquist  rate  for  the  nearly  periodic  signal,  then 
there  are  exactly  p  time  samples  of  the  nearly  periodic  signal  In  each  period.  We  further  assume  that  the 
noise  is  significantly  correlated  only  over  a  number  of  adjacent  time  samples  which  are  small  compared  to  p. 


-7- 


r 


This  implies  that  the  noise  spectrum  does  not  vary  too  rapidly  over  the  frequency  band  occupied  by  the  nearly 
periodic  signal. 

Then  we  define  Zj  to  be  a  1  ■<  p  column  matrix  whose  entries  are  the  p  entries  of  Z  from  (1-1)  p  <  1  lo 
lp  inclusive,  corresponding  to  one  period  of  the  periodic  waveform,  and  X|  similarly.  We  will  assume 
stationary  noise  and  define  f  to  be  the  p<  p  matrix  whose  rows  arc  the  p  entries  of  contained  in  rows 
(i-1)  p  +  1  to  ip  inclusive,  anil  the  columns  of  ihe  same  index,  for  any  i. 

Under  the  above  assumption  about  the  noise  correlation,  and  using  the  notation  described  above,  the  like¬ 
lihood  function  of  Eq.  (Ill- 3 )  can  be  written  approximately  as 

k 

t(ZK)  -  (2-’)-kP/J  |»NprK  2  exp  f  -  y  L  (Z,-  X|  )*  ?nJ,(Z,-X0!  (Ill-  4) 

i  T 

where  k  is  the  number  of  times  p  divides  s.  In  general,  p  will  not  divide  s  evenly,  and  so  Eq.  (Ill- 4)  ignores 
a  portion  of  the  input  signal  in  computing  the  likelihood  function.  However,  for  k^>  1  (l.e.  ,  many  periods), 
this  excess  signal  will  make  a  negligible  contribution  to  the  likeliliood  function,  and  so  can  be  neglected  for  the 
sake  of  simplicity. 

Equation  (HI-4)  is  an  example  of  how  the  computation  of  the  likelihood  (unction  (or  a  specific  problem  can 
resul*  in  an  adaptive  interpretation  for  the  processor.  The  equation  shows  that  the  likelihood  function  changes 
each  time  a  new  set  of  p  samples  is  added  to  the  input  signal,  giving  a  sequential  type  adaptive  receiver  as 
discussed  in  Section  II- D. 

B.  Unknown  Parameters 


In  general,  Smd,  f X j ) ,  and  p  are  unknown.  In  this  case,  the  receiver  can  be  designed  using  the  methods 
described  in  Section  II-D  for  handling  unknown  parameters.  The  methods  may  be  intermixed.  If  possible,  It 
is  desirable  to  cse  the  marginal  density  method,  since  it  gives  unconditional  posterior  probabilities. 

For  the  set  of  unknown  waveforms  fXjl ,  we  shall  use  the  marginal  density  method.  We  shall  assume  that 
the  p  samples  in  any  period  of  the  nearly  periodic  waveform  are  zero  mean  Gaussian  random  variables  with 
covariance  matrix  }xp>  which  is  the  same  for  each  period.  We  further  assume  th^t  the  samples  in  the  1th 
and  Jth  periods,  which  are  li-JI  periods  apart,  have  a  cross  covariance  matrix  .  ‘‘il  i^p,  where  0«--l. 
From  these  definitions  we  see  that  the  marginal  density  method  is  still  going  to  leave  the  parameters  ? and 
o  to  be  specified.  We  shall  assume  that  these  parameters  arc  either  known  or  will  be  estimated.  In  the'latter 
case  we  still  proceed  as  through  these  parameters  were  known,  and  substitute  the  estimated  values  (or  the  true 
values  at  the  end. 


The  parameters  p  and  will  be  estimated.  Sino  p  is  a  parameter  o(  a  signal  which  may  not  bepres- 
ent,  it  will  be  estimated  using  the  likelihood  ratio  estimate  (Section  II-F.-2),  i.o.,  by  building  parallel 
receivers,  one  for  each  value  of  p.  The  noise  is  always  present,  and  its  covariance  can  be  estimated  contin¬ 
uously  by  maximum  likelihood  or  some  other  technique.  We  therefore  proceed  as  though  p  and  !jjp  were 

known. 


Now  the  likelihood  function  for  is 

/  (Z1  ■)  dX  /  (Z '  .X)  f(X  I 

■'“XiV17*'  •  :xi)k>1(rxiV 


(111-5) 


assuming  the  (Xj)^  are  independent  of  .  The  integral  on  the  set  'Xj  ^  is  to  be  interpreted  as  the  kp-fold 
integral  on  the  entries  of  X.  In  Eq.  (Ill- 5),  the  first  term  of  ih  *  integrand  is  given  by  Eq.  (Ill- 4).  The  second 
term  is  the  prior  density  of  the  set  of  waveforms  fXj’.^,  i.e.>,  he  prior  density  of  X. 

An  expression  for  the  prior  density  of  the  f  Xj )  ^  can  be  derived  as  follows.  From  the  above  definitions, 
the  covariance  matrix  for  the  s  kp  samples  from  the  periods  of  the  nearly  periodic  waveform  X  Is  the  s  .  s 
matrix  which  can  be  written  as  the  Kronecker  producl<26,  27) 

•  x  I’.-Xp  (III-C) 

where 
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|  p  n  -  -  -  - 

„  1  r  -  -  -  - 

c*  r  I  - 


'  -“‘I 

L.  “ 


.k-i 
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From  the  prope. ..  s  of  Kronecker  products,  the  Inverse  of  lB 

i  p'‘'  ’Xp 

where 

'  1  0 
I  ^ 

P*'  (1-  2) 

I  • 

1.-*' 


This  inverse  of  P  can  be  verified  by  direct  multiplication.  Thus  we  can  write 

f(rXj'k)  =  f(X) 

((V,.-kp  ^  i .  i  - 1/*  ,  1  •  - 1  „ 

-  (fr1)  J  1 1  x I  exP  f  -  -j  X  ?x  Xl 


(2~f  kp  J I  P|  "p  7  '  TXp'  _|C  I 


exp 


,  k  k- 1 

-5-(,-*:,''l1).xi’:xpxi‘-J!)..xi’»XpX, 


»  =7 


k- 1 

.  r  v 

i  - 

i  i 


xi*i  !XpXi-°/  Xl  *Xp  Xl 
i  -t 


(in- 7) 


(ra-8) 


an-9) 


(in- io) 


Now  the  likelihood  function  can  be  evaluated  by  substituting  Eqs.  (Ill- 4 )  and  (m-10)  into  Eq.(in-5)  and 
integrating.  The  integral  is  conveniently  evaluated  separately  for  the  two  values  of  .  Carrying  out  the 
integration,  the  likelihood  function  -0  is 


'  (Zl  -0)  =  (?)'kp/J!!Npl'k/jexp 


1  v  •  *  -  I 

*  1  )  Zi  !Npzi 

i  -  • 


(m-ii) 


and  the  likelihood  function  for  1  is  shown  in  Appendix  A  to  be 


t(ZT  1)  (2")"kp/rf  ?Npl  'k 


I  k> 

exp  -  j  V  Zj'^'p  Z, 
l  i  1 


(in- 12) 


,-k/J..  'rPOt*')'2  k  >a  i  >/J  1  \‘ 

!»Xp'  K  Aj I  exp  ~  }  c, 

,  I  i  J 


where  A,  and  c(  are  given  by  Eqs.  (A4)  and  CA6)  in  Appendix  A. 
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Using  these  results,  the  likelihood  ratio  Is 


(III- 13) 


A  more  convenient  parameter  Is  the  logarithm  of  the  likelihood  ratio. 

k  k 

is 

i-i 


\(Z)  -  In 


'Xp 


,-kA,W!)-P0-'>A  ?  |A, !./';>  S' 


(III- 14) 


Since  the  parameters  p.t^n^r.  and  t^p  are  to  1)0  estimated  If  they  are  not  known,  the  above  equations  arc 
really  for  a  conditional  likelihood  ratio,  as  discussed  In  Section  n-E-1. 

IV.  PRACTICAL  RECEIVER  DESIGN  AND  EVALUATION 


A.  Practical  Receiver  Design 
1.  General  Structure 

In  the  previous  section,  It  was  Bhown  ‘hat  the  receiver  for  the  detection  of  a  nearly  periodic  signal  computes 
the  logarithm  of  the  likelihood  ratio  given  In  Eq.(in-14).  The  expressions  for  the  coefficients  Aj  and  c^  given 
byEqB.  (A4andA6)are  complicated  and  do  not  lend  themselves  to  a  simple  receiver  design. 


A  simple  receiver  design  results  if  the  receiver  computes  the  logarithm  of  the  likelihood  ratio  only  for  low 
slgnal-to-nolse  ratios.  This  Is  also  a  practical  constraint,  since  it  is  not  necessary  for  the  receiver  to  be 
sensitive  at  high  slgnal-to-nolse  ratios  where  detection  is  much  easier.  We  define  low  signal -to -noise  ratio 
as  the  condition  where  the  eigenvalues  of  the  slgnal-to-nolse  ratio  matrix,  5vp  •  are  much  less  than 
unity.  Under  this  condition,  It  is  shown  in  Appendix  B  that  the  coefficients  Aj  and  c<  are  approximated  by 
Eqs.(B2)  and  (B3),  respectively.  Substituting  these  equations  into  Eq.  (m-14),  the  logarithm  of  the  likelihood 
ratio  becomes 


=  In  [(l-cTp/*] 


(IV- 1) 


In  Eq.  (IV- 1),  the  first  term  is  an  additive  constant,  unaffected  by  the  input  to  the  receiver.  The  last  two 
terms  are  the  ones  which  need  to  be  computed  by  the  receiver.  We  shall  denote  these  terms,  without  the  1  "l 
multiplier,  by 

K  ~  1 

q  =  (1-r2)  V  qi  +  q*  (IV-2) 

i-i‘ 


where 


-  i 
*Np 


'Xp 


■np  ZJ 


i  =  1  to  k 


(IV-3) 


The  heart 
matrices  »xp 


of  this  low  sign:.l-to-nolse  ratio  receiver  is  the  computation  of  the  qj.  By  interpre 
and  jjjL  as  linear  filters^,  15)  (which  may  be  time  variable  and/or  unrealizable), 


interpreting  the  square 
this 
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computation  can  be  given  at  least  two  Interpretations:  the  estimator  correlator  Interpretation,  and  the  filter- 
energy  detector  Interpretation.  The  estimator-correlator  Interpretation  shows  the  connection  between  the 
results  obtained  here  and  the  work  of  Kailath,  *2®'  and  also  allows  an  adaptive  explanation  of  the  receiver 
operation  which  Is  a  particular  case  of  the  work  of  Nolte,  *®J  and  closely  parallels  the  work  of  Jakowatz,  8/iuey, 
and  White.  **®'  The  filter-energy  detector  Interpretation  docs  not  provide  the  same  Insights  Into  the  receiver 
operation  but  Is  simpler  both  In  concept  and  Implementation  than  the  estimator-correlator  Interpretation. 

The  estimator-correlator  Interpretation  comes  about  from  the  following  manipulation  of  Eq.  (IV - 3 ) .  Since 
the  matrix  |uL  is  positive  definite,  It  can  be  spilt  into  the  product  of  a  triangular  matrix  and  Its  transpose,  as 
follows:*32'  H 


®Np  ’  wp  ^p 


then  Eq.  (IV -3)  can  be  written 


•  '  j=i 


-  >  c 
l=i 


i-t 


WnZ, 


(IV  -  4) 


(rv-5) 


1  1  *Xp  ’Np  Zj 


Kallath*2®)  has  shown  that  the  filter  W  is  a  prewhitening  filter,  and  In  Eq.  (IV-5^  W_  prewhitens  the  noise 
component  of  each  period  Z.  of  the  received  signal.  The  filter  cascade  Is  the  low  signal-to-noise 

Wiener  filter  which  estimates  the  signal  X(  fronv  Zi  "see  Kailath*2®'1.  In  Eq. (IV- 5) 


ratio  approximation  to  tne  . . . . . 

these  Individual  estimates  are  weighted  by  the 


signal  Aj  irom  tj 

and  added  to  form'  an  over-all  estimate, 


1 


Sc,  =  V 


-] 


- 1 


i=> 


’Xp  ?Np  Zj 


:iv-6) 


of  the  cui  rent  period  Xj  of  the  nearly  periodic  signal.  This  over-all  estimate  is  distorted  by  the  filter  Wp 
to  c-uinpensate  for  the  distortion  of  Z,  by  W_,  and  then  correlated  with  each  of  the  i  prewhitened  input  periods 
WpZ(.  The  matrix  product  inside  square  brackets  in  Eq.  (IV-5)  is  this  correlation.  The  scalars  that  result 
from  the  1  correlations  are  then  weighted  by  the  and  summed  to  give  the  qj.  This  interpretation  of  the 
receiver  can  be  given  an  adaptive  character  by  viewing  it  as  a  correlation  receiver  in  which  the  reference 
waveform  Xj,  given  by  Eq.  (IV - 6),  is  not  fixed  but  instead  estimated  from  the  received  data.  Thus  the  ref¬ 
erence  waveform  adapts  itself  somewhat  in  die  manner  of  the  filter  built  by  Jakowatz,  Shuey,  and  White,  **®* 
but  following  the  theory  described  by  Nolte.*®'  It  is  of  interest  to  note  that  when  -=0  Eq.  (IV-5)  reduces  to 

q,  =  (WpZiMWpJxp^'pZi)  ,  UV-7) 

which  is  the  low  signal-to-noise  ratio  approximation  to  Kailath's*2®)  zero  mean  signal  receiver. 

The  filter-energy  detector  interpretation  comes  about  as  follows.  Since  the  matrix  $Xp  is  positive 
definite,  it  can  be  SDlit  into  the  product  of  a  triangular  matrix  and  its  transpose.  *22) 

»Xp  =  G*G  •  (IV-8) 

Then  Eq.  (IV- 3)  can  be  written  as  the  vector  squared  magnitud. 


<*1 


>: 


'J‘)  °'npzjI 


(IV-9) 


Equation  (IV-9)  shows  that  the  q,  are  the  result  of  passing  the  Zj  through  the  filters  G  and  ^  ,  weighting 
the  filtered  outputs  by  0*_J,  adding  tnem  together,  and  computing  the  energy  of  the  sum.  The  total  illter 
can  be  in'erpreted  in  terms  of  prewhitening  and  low  signal-to-noise  ratio  Wiener  filtering,  but  a  straightforward 
interpretation  in  terms  of  pre-emphasis  filtering  suffices  here.  The  filter  jr,1  has  the  effect  of  emphasizing 
the  regions  of  the  spectrum  where  the  noise  power  is  low,  and  it  emphasizes  these  regions  more  strongly  than 
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a  prewhitening  (liter.  The  Niter  G  Is  the  (liter  whose  spectrum  Is  the  square  root  o(  the  Bpectrum  o(  . 

This  (liter  emphasizes  the  portion  o(  the  spectrum  where  the  desired  signal  Is  expected  to  be,  and  de-empnaBizes 
the  other  regions. 

The  summation  which  (ollows  these  two  (liters  Is  the  means  by  which  the  receiver  takes  advantage  o(  the 
nearly  periodic  structure  o(  the  desired  signal.  The  (titered  wave(orm  sections  arc  weighted  and  added  on  top 
o(  each  other,  and  when  there  Is  a  nearly  periodic  wavelorm  present,  this  sum  will  be  larger  than  when  there 
Is  not.  This  coherent  summing  opeiatlon  is  sometimes  re(erred  to  as  a  circulating  addition,  because  it  can  be 
Implemented  by  a  delay  line  with  (eedback,  l.e. ,  a  recirculating  line. 

This  circulating  adder  Is  completely  equivalent  to  a  frequency  domain  comb  Niter  acting  on  the  output  o( 
the  G  and  |u_  pre-emphasis  Niters.  This  equivalence  Is  shown  in  Appendix  C,  with  the  (requcncy  response 
Y (I)  o(  the  (lifer  given  by  Eq.  (C2).  Taking  the  sampling  Interval  as  the  (undamental  time  unit,  the  comb  (liter 
"tooth*  separation  Is  shown  to  be  1/p,  and  the  tooth  width  between  the  1/2  power  points  is  (l/"p)  In  (1/s),  as 
shown  In  Fig.  1. 


C/e) 


Fig.  1  The  (requency  response  o(  the  comb  (liter  Interpretation  ot  the  weighted  circulating  adder. 


With  this  Interpretation  of  the  circulating  adder  as  a  linear  time  invariant  Niter,  the  pertion  of  the  receiver 
which  computes  qjbecomes  rather  simple.  It  Is  a  cascade  of  the  luL,  G,  and  comb  Niters,  followed  by  an 
energy  detector.  The  energy  detector  computes  the  energy  of  the  filter  output  in  each  successive  period,  and 
these  energies  are  the  qj.  The  remainder  of  the  operation  of  the  receiver  is  dictated  by  Eq.(IV-2).  This 
equation  shows  that  the  quantity  q,  which  determines  is  a  weighted  sum  of  the  q, .  All  the  qj  but  the  last 
are  weighted  by  (l-0»);  this  last  q^  Is  given  unit  weight.  This  weighting  means  that  the  energy  of  the  most 
recent  p  length  section  of  the  filtered  Input  is  given  considerably  more  weight  than  the  energies  of  previous 
sections.  This  is  not  surprising,  since  the  most  recent  coherent  summation  embodied  in  the  comb  filtering 
operation  has  made  use  of  practically  the  same  information  as  the  previous  summations,  except  for  the  last 
p-length  section.  Thus,  the  contribution  of  the  individual  previous  coherent  summations  is  de-emphasized 
relative  to  the  last.  However,  the  contribution  of  the  sum  of  these  previous  terms  is  not  negligible  for  k  on 
the  order  of  (1-p1)”1  and  larger.  This  incoherent  processing  can  make  an  important  contribution  to  the  value 
of  q. 

The  discussion  of  this  section  can  now  be  summarized  in  a  block  diagram  of  the  proposed  receiver  for 
nearly  periodic  signals.  This  block  diagram  is  shown  In  Fig. 2.  In  the  following  sections,  a  discussion  of  the 
Implementation  of  each  block  is  given. 

2.  Details  of  Structure 

The  noise  pre-emphasis  filter  structure  depends  upon  the  noise  covariance  matrix,  which  we  have  assumed 
is  not  known  to  the  designer.  We  have  proposed  to  estimate  this  matrix  from  the  input  data.  The  difficulty  is 
that  this  matrix  must  be  inverted  to  design  the  filter.  This  Inversion  is  made  relatively  simple  by  the  assumption 


-12- 


INPUT  NOISE  SIGNAL  COMB 

PRE- EMPHASIS  PRE-EMPHASIS  FILTER 
FILTER  FILTER 


ENERGY  DETECT  WEIGHTED  DISPLAY  q 
AND  DUMP  ENERGY  AS  A  FUNCTION 


EVERY  p  SAMPLES  SUM  OF  p 


Fig.  2  Block  diagram  of  the  nearly  periodic  signal  detector  and  estimator.  One  such  detector  is  required  for 
each  period  p. 


that  the  noise  is  nearly  uncorrelated  over  a  whole  period  of  the  nearly  periodic  signal.  For  stationary  noise, 
this  means  that  the  noise  covariance  matrix  is  of  the  form 


"Np 


4p  « 


E) 


(IV- 10) 


ft 


t 


when.  7^  is  the  noise  variance,  I  is  the  identity  matrix,  and  E  is  a  matrix  whose  off-diagonal  entries  are 
much  less  than  one,  and  whose  diagonal  entries  are  zero.  The  quantity  of  interest  is  the  inverse  of  this  matrix, 
which  can  be  approximated  by  the  first  two  terms  of  the  binomial  expansion  for  matrices 


Np 


(I  *  E)’’’  1 


-  «  -  E>  • 


uv-in 


The  variance  -rL  and  the  coefficients  of  the  E  matrix  can  be  estimated,  for  example,  from  the  data  by  sub¬ 
tracting  the  estimate  of  the  desired  signal  from  the  input  and  averaging  the  products  of  the  remaining  data  at 
appropriate  time  delays. 


The  signal  pre-emphasis  filter  G  is  uniquely  determined  from  the  nearly  periodic  signal  covariance  matrix 
■v_  in  the  manner  indicated  by  Eq.  (IV - 8 ).  It  is  necessary  either  to  know  this  matrix,  or  to  estimate  it.  For 
a  lfirge  number  of  possible  ^  the  parallel  receiver  method  is  impractical.  There  seems  to  be  no  alternative 
to  having  as  much  knowledge  of  as  possible  available  to  the  designer.  Simply  stated,  this  means  the 
stnngths  and  cross  correlations  orthe  harmonics  of  the  nearly  periodic  signal  must  be  known. 


It  should  be  noted  that  both  the  noise  pre-emphasis  filter  and  the  signal  pre-emphasis  filter  are  time 
varying.  These  filters  must  be  realized  by  an  operation  equivalent  to  multiplying  the  samples  of  each  Individual 
period  of  the  input  by  a  square  matrix,  and  taking  the  result  as  the  samples  of  (he  corresponding  period  of  the 
outpu  .  Furthermore,  the  noise  pre-emphasis  filter  is  unrealizable  in  the  classical  sense  because  the 
matrix  is  not  triangular.  The  time  variant  and  unrealizable  features  of  these  filters  prevent  their  easy  Imple¬ 
mentation  by  analog  networks.  However,  the  matrix  multiplications  can  be  easily  performed  by  a  computer, 
with  speed  as  the  main  limitation. 

The  comb  filter,  or  weighted  circulating  adder,  is  the  heart  of  the  processor.  The  circulating  adder  is 
easy  to  implement,  especially  with  a  computer.  The  only  parameters  of  this  filter  are  p  and  0-  The  param¬ 
eter  p  is  to  be  handled  by  the  estimation  method,  and  hence  need  not  be  known,  since  all  values  of  interest 
can  be  tried  using  parallel  receivers.  The  parameter  r  must  either  be  known,  or  estimated  in  th .•  same 
manner  as  p.  The  estimation  of  these  parameters  is  discussed  further  below. 

The  energy  detection  and  weighted  energy  sum  portions  of  the  processor  are  fairly  straightforward.  The 
energy  detector  simply  computes  the  energy  q,  in  each  period  of  the  comb  filter  output,  and  outputs  this  in¬ 
formation  every  period.  The  weighted  sum  q  is  then  found  by  adding  all  the  qj  weighted  by  l-pJ,  except  the 
most  recent,  which  is  weighted  by  unity.  This  raises  the  question  of  how  many  q^  should  be  added.  This 
question  has  not  arisen  before  because  it  is  inherent  in  the  formulation  of  the  problem  that  the  nearly  periodic 
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signal  la  either  preaent  or  absent  with  fixed  period  for  the  whole  experiment,  ho  the  qj  can  be  added  indefi¬ 
nitely.  If  this  la  not  true,  the  can  be  added  only  as  long  as  the  nearly  periodic  signal  is  present  with  a 
fixed  period,  otherwise  the  performance  ia  degraded.  It  seems  that  thiB  decision  must  be  made  by  the  designer. 
It  may  even  be  advantageous  to  leave  out  the  weighted  energy  sum  altogether,  substituting  eye  integration  in 
connection  with  an  appropriate  display. 

3.  Parameter  Estimates 

As  indicated  at  the  beginning  of  Section  m,  the  estimation  problem  is  automatically  solved  as  a  by-product 
of  the  detection  problem.  The  period  p  is  to  be  estimated  as  part  of  (he  detection  problem,  in  the  manner 
described  below  in  Section  IV-A-3.  The  parameter  p  can  be  estimated  also,  but  need  not  actually  be  displayed. 
The  receiver  can  compute  the  likelihood  function  for  several  values  of  p,  and  always  choose  to  display  the  out¬ 
put  which  gives  the  largest  value  of  q. 

Since  it  is  impossible  to  compute  the  likelihood  ratio  for  every  value  of  p  and  o,  it  is  of  interest  to  know 
how  far  apart  p  and  p  can  be  sampled  without  missing  a  peak  in  the  likelihood  ratio.  In  Appendix  C  it  is 
shown  that  the  period  p  should  be  sampled  at  Intervals  not  greater  than 


where  hma_  is  the  number  of  the  highest  nonzero  amplitude  harmonic  in  the  nearly  periodic  signal.  Similarly, 
it  is  shownin  Appendix  C  that  the  correlation  coefficient  o  should  be  sampled  at  an  interval  not  greater  than 

to  =  o  (l-o )  .  (IV- 13) 

The  remaining  estimate  of  interest  is  the  waveform  of  one  period  of  the  nearly  periodic  waveform .  Since 
thit  parameter  is  changing  from  one  period  to  the  next,  no  special  emphaslsis  placed  on  the  estimation  of  this 
parameter.  Previous  work  on  the  estimation  of  periodic  signals^®'  indicates  that  a  reasonable  waveform 
estimate  can  be  obtained  at  the  output  of  the  comb  filter  If  the  pre-emphasis  filters  are  removed. 

No  analysis  of  the  goodness  of  the  parameter  estimates  has  been  attempted  here.  Such  an  analysis  is 
extremely  difficult  because  of  the  use  of  the  estimated  noise  covariance  in  the  pre-emphasis  filter,  and  is 
perhaps  best  left  to  a  simulation.  For  an  analysis  of  the  estimation  of  periodic  signals  in  noise,  see  Kincaid 
and  Scudder . 

4.  Display 

The  receiver  output  display  would  Ideally  be  the  value  of  q.  In  practice,  a  reasonable  thing  to  do  is  to 
display  q  as  a  function  of  p,  to  give  the  observer  a  feeling  for  the  output  when  there  is  no  nearly  pe  riodic 
waveform  present.  This  function  should  be  displayed  at  successive  time  intervals  to  give  a  three-dimensional 
display  having  time  as  one  of  the  dimensions,  the  other  two  being  q  and  p.  The  observer  then  has  (in  effect) 
the  conditional  likelihood  ratio  as  a  function  of  p  and  time.  From  this  he  must  estimate  the  period  and  make 
a  decision. 

The  observer  would  not  consciously  go  through  the  mathematics  required  to  make  the  decision.  Instead, 
he  would  look  for  peaks  in  the  display  which  are  significantly  higher  than  the  surrounding  level.  After  some 
experience,  the  operator  is  usually  able  to  tell  if  these  bumps  are  significant,  which  is  presumably  similar 
to  estimating  the  period,  inserting  the  necessary  a  priori  probabilities  and  costs,  and  making  a  decision. 

B.  Receiver  Evaluation  as  a  Detector 


The  theoretical  evaluation  of  the  receiver  in  terms  of  average  cost  is  precluded  by  the  fact  that  we  cannot 
specify  prior  probabilities  and  decision  costs.  A  standard  measure  of  performance  is  the  Receiver  Operating 
Characteristics  (ROC),  described  in  Section  n-E-1. 

In  our  case,  the  output  which  we  should  test  against  a  threshold  to  obtain  ROC  plots  is  the  random  variable 
q  given  by  Eq.  (IV-2).  Unfortunately,  it  is  in  general  very  difficult  to  get  the  probability  distribution  of  q  when 
the  signal  is  present.  However,  ROC  curves  can  be  obtained  for  a  detector  which  computes  just  q^  instead 
of  the  sum  q.  This  means  that  the  detector  does  not  perform  the  incoherent  summing  operation  after  filtering 
and  energy  detecting.  This  detector  is  easier  to  evaluate  because  it  eliminates  the  problem  of  handling  the 
sum  of  the  highly  dependent  q^  when  the  signal  is  present. 
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In  order  to  make  an  evaluation  of  the  proposed  receiver  for  a  particular  case,  consider  the  following. 
Assume  the  nearly  periodic  signal  In  each  period  is  of  the  form 


l 

Xp(t)  •=  Rey  am  exp(Jam)  exprj2n(m/pH]  (IV-14) 

m-i 


where  the  am  are  Independent  random  variables  with  the  same  known  variance  and  p  is  assumed  known. 
The  are  uniformly  distributed  between  -n  and  n,  and  are  independent  of  the  ar  i.  The  period  p,  the 
perloa-lo-perlod  correlation  p,  and  the  number  of  components  l  are  assumed  known.  In  general  terms, 

Eq.  (IV-14)  is  a  model  of  a  signal  which  Is  the  sum  of  l  random  harmonic  "line"  components,  where  the  spectral 
width  of  the  lines  is  determined  by  p.  Each  harmonic  is  independent  of  the  others,  but  they  all  have  the  same 
average  power.  We  assume  the  noise  is  white  with  known  variance  tojj. 

Under  these  assumptions,  it  is  shown  in  Appendix  D  that  the  random  variable  qj.  is  chi-squared  distributed 
with  2i  degrees  of  freedom,  both  when  the  signal  Is  present  and  when  it  is  absent.  The  expected  value  of 
is  shown  to  be 
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r?  \ 
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for  9=1 

2lr 

T7 

for  9=0 

(IV- 15) 
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where  r  =  i.e.,  the  input  signal-to-noise  atio. 

the  output  signal-to-noise  ratio 


snr  = 


We  could  define  the  ratio  of  these  two  expectations  as 


(IV- 16) 


By  this  definition  the  snr  is  independent  of  the  number  of  harmonics  l.  However,  the  ROC  curves  for  this 
detector  shown  in  Fig.  3  reveal  a  strong  dependence  upon  t.  The  computation  of  these  curves  explained  in 
Appendix  D.  Note  that  the  curves  are  dependent  upon  the  product  nr,  where  n  is  the  number  of  periods  at 
which  the  signal  correlation  drops  to  50t,  and  r  is  the  input  signal-to-noise  ratio.  The  quantities  n  and  p 
are  related  by 


o 


n 


(IV- 17) 


The  effect  of  increasing  the  number  of  dimensions  is  dramatically  shown  for  the  case  nr=l.  For  a  false  alarm 
rate  of  10”2,  the  probability  of  detection  increases  from  about  15^  to  over  90t  as  the  number  of  harmonics 
increases  from  1  to  15. 

Since  the  detector  which  computes  q  instead  of  q^  would  do  even  better,  there  is  considerable  reason  for 
optimism  about  the  performance  of  the  proposed  detector.  This  optimism  is  tempered  by  several  factors. 

First  of  all,  we  are  not  likely  to  have  equal  strength  Independent  harmonics;  in  fact  we  are  not  likely  to  be 
certain  a  priori  of  the  number,  strength,  and  dependence  of  the  harmonics.  The  detector  design,  specifically 
the  parameter  $y_,  must  be  based  on  some  assumption  about  the  signal  structure.  To  an  extent,  practical 
receivers  might  d§  able  to  treat  as  a  random  variable  to  be  estimated,  and  try  many  different  combinations 
of  harmonics.  At  any  rate,  a  receiver  designed  for  a  large  number  of  harmonics  will  perform  poorly  when 
trying  to  detect  a  signal  with  only  one  or  two  strong  harmonics. 
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PROBABILITY  OF  FALSE  ALARM 

Fig.  3  ROC  curves  of  the  equal-strength  independent  harmonic  detector  with  no 
incoherent  summing  and  a  known  period . 
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APPENDIX  A 

We  wish  to  evaluate  the  Integral  on  the  right  of  Eq.(HI-S) 

t(ZKp)  =■  jSdx|lk  t(Z|o,  fX,)k),  f({X,}k)  IA1) 

lor  0-1.  Substituting  Eq.  (Ill- 4)  for  the  first  term  in  the  integrand,  and  Eq.  (Ill- 10)  for  the  Becond  term  gives 

•  k 

t(#  =  D  =  fWi)  (2T)'kp/,|»Npfk/,exp  ;-  ^  (Zj-Xt)*  t^,p(Z1-Xl)j 

(2.)-kP/j(l-r2)-P<k-'^,,Xp|-k'/j 

i  -k  k  =  i 

exP  )* (i"°2)" 1  }’  xi*»XpXi  +  pl^  Xi*»XpXl 


Xi-M  *Xp  Xi  ■  p  Xi  *Xp  Xi  +  |  ' 

i=i  r=i 


(2-rkp!*xpi"kA  i»Nprk/2  u-0Tp(k'1)/2 


J{dXi}kexp  j|  ^  (Xi-Zj)*  »Np  (Xi-Z|) 
+  Xj’d-o2)-1  »xp  xi +  xk*^*°2)" 1  ®Xp  x 


+  v  Xj *(l+o2)  (1-d2)"  1  Xj 


K-  1  n. 

y  x;+1  D(i-B2)” »xp x^o-p2)-1^^, 


The  strategy  is  to  get  the  exponent  into  a  sum  of  quadratic  forms  in  the  variables  Xj,  plus  a  remainder  term. 
Then  each  quadratic  form  can  be  integrated  as  a  Gaussian  joint  density  function.  By  investigating  the  iteration 
of  this  process,  the  portion  of  the  exponent  in  the  brackets  can  be  shown  to  be  equal  to 


where 


I  (Xj-AjBj)*  Aj1  (Xj-AjBj)  ♦  Zj*  »Np  ZpCj 
i=i 


Ai '  =  ?Np  +  '  ?Xp>  ' 

Ai '  =  }N1p+^1+o2^1's^"1?Xp‘0^1's^’1  fXp  Ai-i  ?Xp 

for  1  <  i  <  k , 

Ak*  "  *Np  +  ^'°2)  '  ’Xp  *  d(1-°^  '  *Xp  Ak-|  d(1_o2)  *  »Xp  j 
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••<%*>  »xpX,.(  •' 
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.  I  i-J 


/  I 


- 1 


-U-.W)  *  Xp  A; 


*Np  Zj 


k 

r- 

]’-• 

i 


- 1  -i 

"  cd-o1)  *Xp  At 
l- 1 


•Np  zj 


v .  t-J  ... 

"  tU'ffl'  *XpA4  *  Np  zj 


')-■ 


H 


A(  i  ^  "  5  C'-o2)  1  »Xp  At  *Np  ZJ 


-  I 


Us* 


1  =  1 


>■  (A5) 


y  (a  e) 


The  parameters  of  most  interest  are  the  A|,  which  are  the  covariance  matrices  of  the  quadratic  forms  in  Xj, 
and  the  cj  which  determine  the  ultimate  form  of  the  detector. 

Now  carrying  out  the  integration  indicated  in  Eq.  (A 2 )  gives 


KZ|«  =  1)  -  (2-)'kp/2  t»Xpfk/:  hNprk/J(l-o2)’p(k'1,/2  "  Mj I  iA 


|  k  k 

exp  1-  -j  zi  }Np  zi  +  7  ci 

I  i=*  *=' 


1 


k 

l  =  i 


(A7) 


I 
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APPENDIX  B 


Since  the  coefficientt  Aj  and  Cj  In  Eq.  (Ill- 16)  are  too  complex  to  be  Implemented  easily ,  some  simplifying 
assumptions  arc  n.ceBsary.  We  shall  Investigate  the  case  of  low  slgnal-to-nolse  ratio.  We  define  low  slgnal- 
to-nolse  ratio  to  be  the  condition  that  the  eigenvalues  of  the  slgnal-to-nolse  ratio  matrix  *Xp*Np  ar'’  than 
unity.  Now  we  note  that  for  low  signal -to-nolse  ratio 


A  i 


(l-o2) 


=  [?Xp  *Np  +  '  rl  *Xp 


(Bl) 


-  (l-o’)  »Xp  • 


Substituting  this  result  into  Eq.  (B 4)  for  A2,  A3,  etc. ,  we  find  that  in  general 


(1-p2)  ?xpl  1  I  k 


7Xp 


i  =  k 


Substituting  this  into  Eq.  (B6)  for  Cj  gives 


L - 

\  j=> 


I  <  k 


i  k 

\  *  7k  .  .  \ 

(  /  "k'J  ?Np  Zj 

W  l  0  'J  *N'p Zj ) 

;  i  =  k 

\j=i  ’ 

(B2) 


(B3) 


Note  that  the  last  term  in  the  sum  of  the  Cj  is  emphasized  much  more  strongly  than  the  other  terms. 
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APPENDIX  C 


The  response  of  the  weighted  circulating  adder  to  a  unit  impulse  at  time  t  =  0  is 

y(t)  'i(t-jp) 

j=o 


=  u _ ,  (t )  pt/p  7  «t-kp) 
i=-“ 

where  p  is  the  length  of  the  waveforms  to  be  added,  and  u.,(t)  is  the  unit  step  function. 


U(  (t)  = 


'  0  for  t  <  0 


1  for  t  a  0 


The  filter  frequency  response  is  the  Fourier  transform  of  the  system  response  to  a  unit  impulse  applied  at 
time  t  =  0.  Taking  the  Fourier  transform  of  both  sides  of  Eq.  (Cl)  gives 


Y(f)  = 


In(l/o)+jZnf 


"  7  ^/p)  8(f-h/p) 
h=-® 


~L  WWOT 

n=-« 

where  *  denotes  convolution  here.  This  is  the  system  function  of  a  comb  filter  with  "teeth"  having  the  form 
of  the  functions  on  the  right  of  Eq.  (C2).  The  teeth  are  spaced  1/p  apart.  The  tooth  width,  as  measured  be¬ 
tween  the  1/2  power  points,  is  (1/np)  In  (l/o). 

In  Section  IV-A-3,  it  is  argued  that  it  is  desirable  to  know  how  far  apart  values  of  p  should  be  chosen  so 
that  the  comb  filter  would  be  sure  to  pass  significant  energy  from  a  nearly  periodic  signal  with  period,  say,  p0. 
Since  varying  the  value  of  p  makes  the  largest  change  in  the  center  frequency  tooth  corresponding  to  the  highest 
harmonic  hmax,  we  need  only  concentrate  on  that  tooth.  We  shall  adopt  the  criterion  that  the  increment  a p 
should  not  move  this  tooth  further  than  the  distance  between  its  half  power  points.  This  tooth  is  centered  at 
the  frequency 


Therefore, 


f+Af  = 


Ap  for  Ap  «  p  . 


Substituting  the  distance  between  the  half-power  points  for  Af  into  Eq.  (C6) 


f)- 


We  also  want  to  know  how  far  apart  the  values  of  o  should  be  chosen  bo  that  the  value  of  c  which  gives  the 
maximum  processor  output  will  not  be  missed.  The  main  effect  of  changing  r  is  to  change  the  width  of  the 
teeth  of  the  comb  filters.  If  the  teeth  are  wider  than  the  line  width  of  the  nearly  periodic  signal,  too  much 
noise  will  get  through.  If  the  teeth  are  too  narrow, only  a  portion  of  the  signal  will  be  passed  by  the  comb  teeth. 
This  latter  effect  tends  to  spread  the  signal  energy  over  the  comb  filters  for  several  different  values  of  p.  It 
seems  that  a  reasonable  criterion  is  to  require  that  the  changes  In  o  increment  the  comb  tooth  width  by  a 
factor  of  two,  so  that  the  signal-to-noise  ratio  does  not  change  by  more  than  a  factor  of  two.  Therefore, 


_1_ 

nP 


In 


q  -  A  n 


(C  3) 


Solving  this  equation  for  ao  gives 


An  -  p(l-n) 


(C  9) 
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APPENDIX  D 


We  wish  to  find  the  probaDllity  density  function  of  the  random  variable  q^  given  by  Eq.  (IV-3)  when  the 
noise  is  white  and  the  waveforms  of  the  periods  of  the  nearly  periodic  signal  are  of  the  form  specified  by  Eq. 
(IV- 14). 

We  note  that  Eq.  (IV- 10)  can  be  written  as  follows: 


X  (t)  =  Re^  am  exp(Jam)  exp[J2n(m/p)t] 

m 


(Dl) 


where 


cos  2n(m/p)t  -  aml  sin2n(m/p)t 


a  mr  "  a  m  008  am 
a  ml  =  ak  8inak  • 

Then  by  the  assumptions  made  on  the  an  and  o^,  the  following  statistical  averages  can  be  computed 


^amr^  "  (amf  "jr 

b 

ii 

(D2) 

<amranr>  =  <amtani>  =  0  1 

m  ft  n 

(D3) 

~amrani>  =  0  •  411  m>n  • 

(D4) 

Furthermore,  the  coefficients  amr  and  amj  are  Gaussian  random  variables  since  they  ;>re  linear  transfor¬ 
mations  of  the  time  samples  of  the  sample  functions  of  a  Gaussian  process. 

The  equations  (Dl)  through  (D4)  show  that  the  set  of  functions  (cos  2n  (m/p)t;  sin  2-r(m/p)t)  is  an  (ortho¬ 
normal)  basis,  with  statistically  independent  coefficients,  for  the  sample  functions  in  each  period  of  the  nearly 
periodic  waveform.  Note  that  die  cosine  or  sine  coefficients  of  the  same  order  in  different  periods  cannot  be 
independent  because  of  the  assumed  period  to  period  correlation  o.  Also,  note  that  all  the  coefficients  amr 
and  amj  have  the  same  variance  o^. 

In  this  new  coordinate  system  of  harmonic  cosines  and  sines,  the  covariance  matrices  and  are 
diagonal.  The  matrix  is  diagonal  because  white  noise  has  independent  coefficients  in  any  basis. 

*Np  =  24oj,  I  .  (D5) 

The  matrix  is  diagonal,  and  will  be  of  the  form 

Ijjp  =  2  L  I  .  (D6) 

With  the  noise  and  covariance  matrices  given  by  Eqs.  (D5)  and  (D6),  the  expression  for  given  by 
Eq.  (IV-3)  becomes 


21 

-Z  n- 

i=i 

where  the  zy  are  the  entries  of  the  matrix  Zj . 
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Now,  since  cjk  Is  the  sum  of  squares  of  Identically  distributed,  zero  mean,  Gaussian  random  variables,  it  Is 
chi  squared  distributed,  wltn  Zl  degrees  of  freedom.  Therefore,  the  only  parameters  neeued  to  completely 
specify  their  distribution  are  l  and  (yj).  We  note  that  since 


then 


<zUizij2>  =  »Jifc  ^  +  »olfc-J>l  ax 
k  k 

<yj>  “ofcsN  ^  Y  ok_Jl  d*"1*  <*i],* ij,> 
Jri 


(D8) 


(D9) 


= 


-4 


X  aN 


r  k 


*<k-j) 


0  '  "  "n  L 


k  k 

V  Pk-I|0HJ 

ji=‘  Ji=' 


J  2”J  1 1  _2 


ax 


We  assume  now  that  k  is  much  larger  than  (l-o2)’\  i.e. ,  k  is  sufficiently  large  that  the  correlation 
between  the  first  and  the  kth  period  is  essentially  zero.  Then  the  following  approximations  are  valid 


ri 


1 

1^7 


(DIO) 


k 

1 

jr1 


k 

/ 

)2=1 


k-j i  k-j2  Jjj-j, 


1 

'1=7 


Substituting  Eqs.(D10, 11)  into  Eq.(D9) 


(Dll) 


(D12) 


where  r  =  the  signal-to-noise  ratio  per  dimension,  which  is  the  same  as  the  over-all  ratio. 

The  tables  of  the  chi- squared  distribution  are  given  for  <79  =  1$  ^  Thus  by  dividing  the  variable  q^  by  a2 , 
the  probabilities  of  detection  and  false  alarm  can  be  found.  When  the  threshold  is  set  at  some  level  17,  the’ 
probabilities  of  detection  is  the  probability  that  q^A?  exceeds  r\/o\  •  The  probability  of  false  alarm  is  the 
probability  q^/aj  exceeds  ri/uj.  Since  the  tables  give  the  probability  that  the  variable  exceeds  chi  squared 
for  various  values  of  chi  squared  and  l,  the  probabilities  of  detection  and  false  alarm  can  be  read  directly. 

On  making  up  the  ROC’s,  it  is  desirable  to  make  the  number  of  lines  one  of  the  parameters.  It  must  be 
remembered  that  each  line  consists  of  two  dimensions.  Furthermore,  0  as  a  parameter  is  hard  to  measure 
directly.  A  more  easily  measured  parameter  is  the  number  of  periods  n  at  which  the  correlation  between 
the  first  and  the  nth  period  drops  to  1/2,  i.e.,  where  o11  =  1/2.  A  further  simplification  results  if  we  assume 
n  >  10,  i.e. ,  0  >  0.933.  in  which  case  l+o2^. 
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